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Abstract 



We show how to calculate the finite-state dimension (equivalently, the finite-state compressibility) of 
a saturated sets X consisting of all infinite sequences S over a finite alphabet E m satisfying some given 
condition P on the asymptotic frequencies with which various symbols from E m appear in 5*. When the 
condition P completely specifies an empirical probability distribution 7r over E m , i.e., a limiting frequency 
of occurrence for every symbol in E m , it has been known since 1949 that the Hausdorff dimension of X 
is precisely TL{tt), the Shannon entropy of n, and the finite-state dimension was proven to have this same 
value in 2001. 

The saturated sets were studied by Volkmann and Cajar decades ago. It got attention again only 
with the recent developments in multifractal analysis by Barreira, Saussol, Schmeling, and separately 
Olsen. However, the powerful methods they used - ergodic theory and multifractal analysis - do not 
yield a value for the finite-state (or even computable) dimension in an obvious manner. 

We give a pointwise characterization of finite-state dimensions of saturated sets. Simultaneously, 
we also show that their finite-state dimension and strong dimension coincide with their Hausdorff and 
packing dimension respectively, though the techniques we use are completely elementary. Our results 
automatically extend to less restrictive effective settings (e.g., constructive, computable, and polynomial- 
time dimensions). 

1 Introduction 

Since the study of normal numbers by Borel in 1909 [3], sets of real numbers specified in terms involving 
frequencies of digits in their expansions have been repeatedly under the spotlight. Borel's results show that 
the set of real numbers for which the asymptotic frequencies of digits in the expansion follow the uniform 
distribution (normal numbers) has measure 1. However, this means that all sets of real numbers defined 
with any other asymptotic frequencies are measure sets. Hence Lebesgue measure could not give more 
insight into such sets. 

The introduction of Hausdorff dimension in 1919 ,T5] provides us a powerful tool to analyze the relative 
size of measure sets and their geometry. This also enabled the study of sets of non-normal numbers defined 
by asymptotic frequencies of digits. Besicovitch (1934) [3] proved that in Cantor space C 



in the first n bits of S, and 7^2(0 is the binary entropy function. Then in 1941, Good [12] conjectured that 
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where f3 € [0,A], FREQ 
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dim H (FREQ /3 ) = H a (G9. 1 - P)), 



which was only proven in 1949 by Eggleston [9], where FREQo = {S € C | lim tto(S, n) = (3}. It is worth 

noting that these are also among the earliest attempts to study the dimension structures of non-compact 
sets. 

In 2000, Lutz gave a gale characterization of Hausdorff dimension and generalized Hausdorff dimension 
to resource-bounded and constructive dimensions [17\ I18j and finite-state dimension [8j (with Dai, Lathrop, 
Mayordomo) . For any set X, the dimensions following the inequality 

dim FS (V) > dim A pO > cdim(V) > dim H (X), 

where A is some computable resource bound. In 8 , the finite-state dimensions of the above sets are shown 
to be the same as their Hausdorff dimensions. 

Volkmann {30] and his student Cajar in his 1981 Ph.D. thesis [5] investigated more sets of this kind, with 
the central component of the definition of the sets being that they are saturated, as they are the sets that 
contain all the real numbers with some prescribed restrictions on the asymptotic behavior of the frequencies 
of digits. Cajar called these sets saturated sets. Volkmann [3U] established that the Hausdorff dimension of 
saturated sets follow the maximum entropy principle, i.e., the Hausdorff dimension takes the value of the 
maximum entropy of the frequency allowed by the constraints in the definition of the saturated set. 

It is important to note that the set FREQ-' 3 exhibits the decomposition 

FREQ^ = |J {S E C | limsup7r (S>) = 0}. 
Denote {S £ C| lim sup TVo(S,n) = /?'} as A^/. Each component Api has Hausdorff dimension 

n — >oc 

dim H (A /3 0=H 2 ((/3 / ,l -/?'))• 

Now we have that 

dim H (FREQ-' 3 ) = sup dim H (A /3 0- 

The dimension magically exhibits stability under the uncountable union of the decomposition, which is not a 
typical behavior of the Hausdorff dimension, since it is only countably stable in general. The decomposition 
here is not artificially chosen to make the uncountable stability happen. This is the standard decomposition 
done in multifractal analysis to study the properties of the level sets in the fractal spectrum. The phenomenon 
of this uncountable stability was observed by Cajar from earlier works along this line [3], |T51 [J? . 10, 29, 30, 6] and 
led to the his own investigation [5]. However, besides Volkmann and Cajar, it was not until the 21st century, 
after the development of multifractal analysis, that this phenomenon was investigated again. Barreira, 
Saussol, and Schmeling, in their investigation of higher-dimensional multifractal analysis of some hyperbolic 
dynamical systems, obtained a conditional variational principle that allows the use of the entropy of ergodic 
measures to approximate topological entropy of the level set in the multifractal spectrum. Subsequently, 
they applied that to calculate the Hausdorff dimensions of many saturated sets. Olsen and Winter used 
techniques from large deviation theory to develop a unifying multifractal framework based on the notion of 
deformations of empirical measures [25l ES [20l [24] . Olsen used this new framework to study the saturated 
sets E21 [23] and obtained the Hausdorff dimensions of a wide variety of such sets and some packing dimension 
results. And he mentioned the new multifractal framework as the main source of methods and techniques 
he used to solve the uncountable union problem 23J. 

Olsen noted in [21) that the sets of points whose limit of asymptotic frequencies does not exist received 
little attention in the past except for Volkmann and Cajar until the very recent work on the divergence 
points in multifractal analysis. In this paper, we will further this line of research by extending the results 
about saturated sets, especially, such sets of points whose asymptotic frequencies do not exist, to finite-state 
dimensions. We establish a pointwise characterization of the finite-state dimensions of these sets in terms of 
the asymptotic entropies, namely, 

dimps(^) = sup liminf H(ir(S, n)) 

sex 
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for all saturated sets X, where ir(S,n) £ A(£ m ) is the empirical probability measure drawn from the 
frequencies of the occurrences of digits in the first n bits of S. At the same time, we also establish a 
correspondence principle for Hausdorff dimension of saturated sets, namely, 



Packing dimension is another tool in classical geometric measure theory [28l [27]. In 2004, Athreya, 
Hitchcock, Lutz, and Mayordomo gave a very surprising gale characterization of packing dimension and 
generalized the packing dimension to resource-bounded, constructive, and finite-state strong dimension pQ. 
In this paper, we also investigate the packing dimension and finite-state strong dimension. We establish the 
finite-state strong dimension and packing dimension versions of exact duals of our aforementioned results in 
finite-state dimension and Hausdorff dimension, namely, 



for any saturated set X. Among all the previously mentioned works, packing dimensions results are fewer. 
This is a strong indication that the gale characterization is particularly useful in the sense that for all the 
results concerning Hausdorff dimension and finite-state dimension in this paper, by using the gale charac- 
terization, we immediately obtain dual results about packing dimension and finite-state strong dimension 
using symmetric arguments. Also we use only elementary techniques to prove results that classically needed 
advanced techniques in ergodic theory and multifractal analysis. This fact suggests that gale characterization 
of dimensions and the finite-state dimension are very powerful. 

Section [2] lists the basic definitions and conventions we use in this paper. Section [3] reviews the definitions 
of Hausdorff dimension, packing dimension, finite-state dimension, and finite-state strong dimension. We 
give a few example of calculating the dimensions of exotic saturated sets in Section[4] In Section[5l we discuss 
finite-state dimensions of saturated sets in detail and give insight into why a maximum entropy principle 
holds. 

2 Preliminaries 

Let m > 2 be an integer. We work with the m-ary alphabet S m = {0, 1, . . . , m — 1}. E* n is the set of 
all (finite) strings on X m including the empty string A. C TO = SJ^ is the of all (infinite) m-ary sequences. 
C = C2 is the Cantor space. A(£ m ) is the set of all probability measures on S m . 

Let i be an integer such that < i < m — 1. The symbol counting function : (C m U ££J xN^H 
is defined such that for every string or sequence S and n £ N, #i (S, n) is the number of occurrences of i 
in the first n bits of S. The symbol frequency function 7Tj : (C m U ££J xN^ [0, 1] is defined such that 
Wi(S,n) = #i(S,ri)/n. The empirical measure function 7? : (C m U ££J xN-> A(£ m ) is defined such that 
n(S,n) = (TT()(S,n), . . . , ir m -i(S, n)). Intuitively, tt extracts empirical probability measures from the first n 
bits of a string or a sequence based on the actual frequencies of digits. 

3 The Four Dimensions 

Hausdorff dimension and packing dimension arc important tools in mathematics used to study the size of 
sets and the properties of dynamic systems. All countable sets have for both of these dimensions. In order 
to study relative size of countable sets from the eyes of computers with different resources, Lutz generalized 
Hausdorff dimension to effective dimensions by using his gale characterization of Hausdorff dimension [17j . 
Athreya, Hitchcock, Lutz, and Mayordomo then gave a dual gale characterization of packing dimension, with 
which, they generalized packing dimension to effective strong dimensions pQ. We first review the definitions 
related to gales. Note that E m is an alphabet with m symbols and m > 2. 

Definition. Let s £ [0, 00). An s-supergale is a function d : SJ^ — * [0, 00) such that for all w £ 



dimps(A) = dimn(A). 



dimp(X) = Dimps(A) = sup limsup7i(7r(5 l , n)), 



SEX n^oo 
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The success set of an s-supergale d is 



S°°[d] = {SeC \ limsupd(S[0..ra- 1]) = oo}. 

n — >oo 

The strong success set of d is 

SZ[d] = {SeC \ liminf d(S[0..n - 1]) = oo}. 

n — >oc 

Now we conveniently give the gale characterizations of Hausdorff and packing dimensions as definitions. 
Please refer to Falconer [TT] for classical definitions. 

Definition. ([171 [T]). Let X C C m . The Hausdorff dimension of X is 

dining) = inf {s £ [0, oo) | X C S 100 ^ for some s-supergale d } . 

The packing dimension of X is 

dimp(X) = inf {s £ [0, oo) | X C [d] for some s-supergale d} . 

Finite-state dimension and strong dimension are finite-state counterparts of classical Hausdorff dimension 
[T5] and packing dimension [TH [27] introduced by Dai, Lathrop, Lutz, and Mayordomo and Athreya, 
Hitchcock, Lutz, and Mayordomo pQ in the Cantor space C. Finite-state dimensions are defined by using 
the gale characterizations of the Hausdorff dimension [TTJ and the packing dimension Q] and restricting the 
gales to the ones whose underlying betting strategies can be carried out by finite-state gamblers. In this 
section, we give the definitions of the finite-state dimensions for space C m and review their basic properties. 
Now, we define finite-state gamblers on alphabet E m . 

Definition. ([5]) A finite-state gambler (FSG) is a 5-tuple G — (Q, E m , 5, /3, go) such that Q is a non-empty 
finite set of states; E m is the input alphabet; 5 : Qx E m — > Q is the state transition function; j3 : Q — > A(S m ) 
is the betting function; qo £ Q is the initial state. 



The extended transition function S* : Q x — ► Q is defined such that 

S*(q, wa) 



q if w = a = A, 

<5(<5*((7, id), a) if w ^ A. 



We use 5 for 5* and 5(w) for 5(qo,w) for convenience. 

The betting function /?; : Q — > A(E m ) specifies the bets the FSG places on each input symbol in S r 
with respect to a state q £ Q. 

Definition. (0). Let G = (Q, S m , 5, /3, go) be an FSG. The s-gale of G is the function 

d G ■ Z* m -> [0, oo) 



defined by the recursion 

d G (u;6) 



1 if u; = = A, 

m^GH/^HKb) if a, 



for all w £ E^j and 6 £ E m U {A}. For s £ [0, oo), a function d : E* n — > [0, oo) is a finite-state s-gale if it is 
the s-gale of some finite-state gambler. 

Note that in the original definition of a finite-state gambler the range of the betting function is 
A({0, 1}) n Q 2 [SICE]. In the following observation, we show that allowing the range of [3 to have irrational 
probability measures does not change the notions of finite-state dimension and strong dimension. 



4 



Observation 3.1. Let G = (Q, £ m , 6, /3, qo) be an FSG. For each e > 0, there exists an FSG G = 
(Q,Y. m ,6,i$',q ) with : Q -> A(S m ) n Q m such that for all s e [0,oo), S°°[<4 s) ] C S°°[d<gf e) ] and 

In this paper, we allow the finite-state gamblers to place irrational bets. 

Definition. ([SI [I]). Let X C C m . The finite-state dimension of X is 

crimps (X) = inf { s £ [0, oo) | X C S roo [(i] for some finite-state s-gale d} 

and the finite-state strong dimension of X is 

DimFsPO = inf {s <E [0, oo) | X C «S^.[ei] for some finite-state s-gale d} . 

We will use the following basic properties of the Hausdorff, packing, finite-state, strong finite-state di- 
mensions. 

Theorem 3.2. (J& W- Let x > Y > X i Q S m f° r * G N. 

1. < dim H (X) < dim FS (X) < I, < dim P (X) < Dim FS (X) < 1. 

2. dim H (X) < dimp(X), dim FS (X) < Dim FS (X). 

3- If X C y, i/ien i/ie dimension of X is at most that same dimension ofY. 

4. dim FS (X (JY) = max{dim FS (X),dim FS (y)} and Dim FS (X U Y) = max {Dim FS (X), Dim FS (T)}. 

5. dim H {{Jilo X i) = su Pi6N dim Hp^)> dim P (lJ^ ^) = sup ieN dim P (JQ). 

4 Relative Frequencies of Digits 

As we have mentioned in Section [U Besicovitch in 1934 and Eggleston in 1949 proved the following two 
identities respectively. 

Theorem 4.1. dim H (FREQ^) = H 2 ((P, 1 - /?)) W and dim H (FREQ /3 ) = H 2 ((/?, 1 - /?)) EF- 

In this section, we will calculate the finite-state dimension of some more exotic sets that contain m-adic 
sequences that satisfy certain conditions placed on the frequencies of digits. The proofs in this section use 
straightforward constructions of finite-state gamblers. Both the constructions and analysis use completely 
elementary techniques. 

Let H/3, m (a) = -(cdog m a + (3a\og m Pa + (1 - a - (3a) log m Let 

x < 1 
otherwise. 



a* (a) 
Note that 



l+x + (m-2)x~° 



1 if j9 < 1, 

Hp, m (a"{p)) = sup Hp, m (a) = < log ( m _ 2 + ^ ) otherwise. 

Theorem 4.2. Let /3' > f3 > 0. Let 

v /o r • f 771 n ) ^ a ^ r ^i(S,n) „, 

X = \ b hm mf — — — - > /j and lim sup — — — - > p 

L 7To(S,n) n->oo 7T (D,n) 

T/ierc dim H (X) = dim FS (X) = Hp ,m( a * O 3 ')) and dim P (X) = Dim FS (X) = Hp, m {a*{0)). 
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Corollary 4.3. (Theorem 2 Jgj). Let (3>0. Let 

x = {s 

Let (3' = max{/3, 1/0}. Then 



llm (Q \ = 13 
n— >oo TTq{D, n) 



dimnPO = Hp, m {a*{0')) = log m [ m -2 + i±£ J 

V / 

Note that dimp(X), dim.Fs(X), and Dimps(X) all takes the value of dimH(X), which were not proven 

Proof. We prove the case where f3' = (3. The other case is similar. Let 

Y ={s 

Let 



i iminf ^g4>^ 



z = Is 



lim itq(S, n) = a* '((3), lim ni(S,n) = (3a* {(3), 

n — >oo n — >oo 

and (Vi > 1) lim 7^(5, n) = ^'W-^'W 



By Eggleston's theorem, dimH(Z) = H./3, m (a*((3)). Since 2 C I C 7, it follows immediately from Theorem 
"that dimHpO = H p , m {a* {(3)) . □ 



5 Saturated Sets and Maximum Entropy Principle 

In Section [4j we calculated the finite-state dimensions of many sets defined using properties on asymptotic 
frequencies of digits. They are all saturated sets. Now we formally define saturated sets and investigate their 
collective properties. 

Let n„(S) = {7?(S*, m) | m > n} for all n € N. Let 5„(5) = n n (5_), i.e., fl n (5) is the closure of II n (5). 
Define n : C m -> 7>(A(£ m )) such that for all 5 € C m , 11(5) = f|„ eN n ™(' S ')- 

Definition. Let X C C m . We say that X is saturated if for all S, S' £ C m , 

n(5) = n(s') =^[Sei <^=> s'ei]. 

When we determine an upper bound on the finite-state dimensions of a set X C C m , it is in general not 
possible to use a single probability measure as the betting strategy even when X is saturated. However, 
when certain conditions are true, a simple 1-state finite-state gambler may win on a huge set of sequences 
with different empirical digit distribution probability measures. 

In the following, we formalize such a condition and reveal some relationship between betting and the 
Kullback-Leibler distance (relative entropy) [7]. Note that m-dimensional Kullback-Leibler distance T> m {(3 || 
a) is defined as 

V m 1| a) = E^log m 4 

Definition. Let a, (3 £ A(£ m ). We say that a e-dominates [3, denoted as a >> e (3, if H m (a) > Ti. m (f3) + 
T> m ((3 || a) — e. We say that a dominates (3, denoted as a. >> (3, if a >>° (3. 

Note that n m 0)+V m ((3 \\ a) = E^log m i+E^log m § = E^log m 4, where E /? log m f = E™" 1 ft log m f . 
It is very easy to see that the uniform probability measure dominates all probability measures. 

Observation 5.1. Let a=(±,..., i). Let (3 £ A(£ m ). TTiera a >> /3. 
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Here, we give a few interesting properties of the domination relation. 

Theorem 5.2. Let a = (olq, . . . , afe-i) S A(Efc). Let (3 = (/3 , ■ ■ • , Pk-i) & A(Efc) be such that (3j = 1, 
where j — argmaxjao, ■ ■ ■ , ctk-i\- Then a » ft and Hk(j3) = 0. 

Theorem 5.3. Let a,/3 £ A(E fc ), e > 0, and r £ [0, 1]. If a » e j3, then d » e rd+ (1 - r)/3. 

Theorem 5.4. Let fl = (—,...,—) £ A(E m ) be the uniform probability measure. Let f3 £ A(E m ). Let 
s £ [0, 1]. Let a = sfl+ (1 - s)0. Then a » 0. 

The following theorem relates the domination relation to finite-state dimensions. 

Theorem 5.5. Let a £ A(E fe ) and X C 

//a >> e jf(S,n) for infinitely many n for every e > and every S £ X, then dimFs(^0 — ^fc(a?). 

2. If a >> e 7r(5, n) /or all but finitely many n for every e > and every S £ X , then Dimps(^) _• Hk(ct). 

Theorem 15.51 tells us that if we can find a single dominating probability measure for X C C m , then a 
simple 1-state FSG may be used to assess the dimension of X. However, in the following, we will see that 
the domination relationship is not even transitive. 

Theorem 5.6. Domination relation defined above is not transitive. 

Fix a £ A(E m ) with Ti m (d) ^ 1, the hyperplane H in W n defined by 

m — 1 _^ 
W m (<3) = V, X i l0 Sm — 

divides the simplex A(E m ) into two halves A and B with A <~) B C H . Suppose ( — , . . . , — ) £ B, then 
A = £ A(E m ) | a » f3}. 

So it is not always possible to find a single probability measure that dominates all the empirical probability 
measures of sequences in X C C m . Nevertheless, we take advantage of the compactness of A(E m ) and give 
a general solution for finding the dimensions of X C C m , when X is saturated. The following theorem is 
our pointwise maximum entropy principle for saturated sets. It says that the dimension of a saturated set 
is the maximum pointwise asymptotic entropy of the empirical digit distribution measure. 

Theorem 5.7. Let X C C m be saturated. Let 

H = sup liminf TL m (T:{S, n)) 

sex n -*°° 

and 

P = sup limsup7i m (7r(5 l , n)). 

Then dimps(^) = ditriHpO = H and Dimps(^) = dimp(X) = P. 

This theorem automatically gives a solution for finding an upper bounds for dimensions of arbitrary X. 

Corollary 5.8. Let X C C m and let H and P be defined as in Theorem \5.7\ Then dimps(^) < H and 
Dim FS (^) < P. 

In the following, we derive the dimensions of a few interesting saturated sets using Theorem 15. 71 We will 
give more examples in the full version of this paper. 
Let H a . m = bgja-^l^)"- 1 ]. 
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Theorem 5.9. Let a, a £ [0, 1] such that l/m < a < a and let 

Mjr' a = {S € | liminf irk(S, n) = a and limsup7Tfc(S', n) = a}. 

n >oo n — >00 

Then dim H (Mf'") = H a , m and damp(Mf' a ) = Ha, m - 

Proof. It is easy to check that M^' a is saturated, that H & m = inf ag [„ a j iJ Q)m , and that Ha, m — SVL P a e[a a] H a , m . 
The theorem follows from Theorem 15. 71 □ 

Corollary 5.10. Let a, a £ [0, 1] such that a< a and let 

Mjr' a = {S S C m | lim inf tt^ (S, n) — a and limsup7T/ c (<S', n) = a}. 



Then 



dim H (Mf'") = inf H a , m = Tnixi{Hu,m,H gi , m ) 

a£ [a. a] 



1 Q. < l/ m — a ' 



dimp (Mr' ) = sup _ff Q m 

o6[a,s] I max(ff am ,ffa im ) otherwise. 



Proof. If a < l/m < a, then for some S 1 G Mr' , limsup?i m (7r(S', n)) = 1. □ 

n — >oo 

Corollary 5.11. (Theorem 7 JB/). Let a kl a k e [0, 1] /or fc e S m . Le£ Mr = 0^ Aff*'"*. ™en 

dimps(-Wii) = dimn(-Mfl) = min dimn (Mj[r' ) 

and 

m ~ i - 
Dimps(-^_R) = dirap(Mfl) = mindimp(Mr-' ). 

Corollary 5.12. (Theorem 1 J^). Let k G S m anc! let 

Mh = {S € C m | liminf 7Tfe(x, n) < limsup7Tfc(a;, rt)}. 

n >oo n — > qq 

Then dimndHfe!^) 1 Affc) = 1- 

Theorem 5.13. Let A be a d x m matrix and b = {b\, . . . ,bd) € R d - Let 

K i o (A, b) = {Se C m | (3{fc„} C N) lim k„ = oo and lim A(t?(S, fc„)) T = &} 

n— *oo n — »oo 

and to if (A, 6) = {S e C m | lim A(n(S, n)) T = b}. Then 

n— »oo 

dim FS (K io (A,b)) = dim H (K io {A,b)) = sup H m (a), 

aeA(E m ) 

dim P (K Vo (A,b)) = 1, and 

dim K {K(A, bj) = Dim FS (K{A, b)) = sup H m (a). 

a€A(S m ) 
Aa T =b 

Proof. It is easy to check that K 10 (A, b) and K(A, b) are both saturated. □ 
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6 Conclusion 



A general saturated set usually has an uncountable decomposition in which, the dimension of each element is 
easy to determine, while the dimension of the whole set, which is the uncountable union of all the element sets, 
is very difficult to determine and requires advanced techniques in multifractal analysis and ergodic theory. By 
using finite-state gambler and gale characterizations of dimensions, we are able to obtain very general results 
calculating the classical dimensions and finite-state dimensions of saturated sets using completely elementary 
analysis. This indicates that gale characterizations will play a more important role in dimension-theoretic 
analysis and that finite-state gambler is very powerful. 
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A Appendix for Section [3] 



Proof of Observation [3711 Let 6 = min ge Q mixii—o,. m (j3i(q) — 2 y" ) . For all q G Q, let ^(g) G [/3i(<?) — 
<5,A(<?)] n [0,1] n Q, if i ^ 0. Otherwise, let = 1 - E^i^te)- Note that for all q £ Q and all 

i G {0, . . . ,m — 1}, 

> A(g) - S > o 



and that /?' maps states to rational bets. 
For w G SI , let 



# 9i (iy) = |{n | < n < \w\ - l,8(w[0..n - 1]) = q and iy[n] = 



Note that 



m— l 

H = EE #*( 



Now we have that for all w G S„ , 



(A.1) 



(A.2) 



g(=Q z__0 

m— 1 

gSQ i=0 
m— 1 

n n^(?)-^ 2e ] #9i(w) ' 



By the choice of 5, 



m— 1 

4 +e) H > ^m^i n n tow - ow - ^))2 e ]^(-) 

m— 1 
g£<2 i=0 



Thus, for all 5 G S 00 ^], 



limsupciQ, +c ' ) (S') > limsup(i G i ' ) (<S') = oo, 



and for all 5 G S%.[d$], 



Therefore, 
and 



liminf d& e) (S) > Uminf d!g'(S) = oo. 

n—>oo n— >oo 



□ 
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B Appendix for Section [4] 



Proof of Theorem 14.21 We assume that (3' > f3 > 1, since when either of these values are less than 1, the 
proof is essentially looking at the subset of X where their values are replaced by 1. First, we prove the lower 
bounds for the dimensions. 

When S is clear from the context, let a n = tto(S, n) and j3 n — ki(S, n). 

Let a' = a*(/3') and let a = a* {(3). 

For Hausdorff dimension and finite-state dimension, let 

Y = < S lim a n — a', lim (3 n — /3'a',and (Vi > 1) lim Ki(S, n) — 

By Eggleston's theorem, we have dim H (T) = Hpr >m (a* (/?'))• Since j3' > (3 > 1 and Y C X, 

dim FS (X) > dim H (X) > dim H (T) = Hp>, m (a* (/?'))■ 
For packing dimension and finite-state strong dimension, let 

1 — a — (3a 



Z 



lim a n = a, lim (3 n = (3a, and (Vi > 1) lim TTi(S,n) 



m-2 



Now we construct from Z a set Z' C X by interpolating the sequences in Z. 
First let Z = 2 and for every i e N, h+i = 2 lz . 

Define /o : E* t — > E* 4 be such that /o(w) = w for all w G E* n . Let p = a;3 /_ 1 a/3+1 ■ For each n > 0, define 
f n : E* n — > Ej^ such that for every w S S* n , |/n(w)| = \w\ and for every i < \w\, 



fn(w)[i 



Define / : EJ„ — > E^ such that for all io € E^ 

/(w) = f n (w)(w), 

where n(w) = min{n S N | Z„ > |«;| }. Also, extend / to / : E^ — > such that for all 5" e E 

/(S)= lim f(S[0..n-l}). 



fn-l(w)[i] 


i < l n -i 






w[i] 


i < {pl n ] 


and i 


> In— l 


1 


i > \pl n ] 


and i 


< L 


w[i] 


i > l n . 







oc 
m s 



Let Z' = f(Z). 

By the construction of / and choice of p, it is clear that / is a dilation and for all n G N, |Col(/, 5[0.. [pZn] — 
1])| < logZ n . Thus for all e > 0, there are infinitely many n such that 

|Col(/,S[0..n- 1])| < en. (B.l) 

Note that by Eggleston's theorem, dimH(Z) = Hp, m (ct*((3))- Then by Supergale Dilation Theorem [13] 
and JHU), dimp(Z') > Hp, m (a*{(3)). 

It is easy to verify that for every S £ Z', 

lim inf — > (3 and lim sup — > . 

n->oo a n n->oo a n 

SoZ'CI. Therefore, Dim FS (X) > dim P (X) > Hp, m (a*(j3)). 

Now, we prove that Tip' , m ( a * W)) is an upper bound for dining) and dimps(A). 

If (3' < 1, then Tipi >m (a*(/3')) = 1 an d the upper bound holds trivially. So assume (3' > 1. 
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Let a = a* (/?')• Let s > Hp , m {a*{f3')). Define 

d(wb) = < 



m s ad(w) 6 = 

TO s /3'adH b = 1 



It is clear that is a finite-state s-gale. 
Let 



Let 



e = 



B = /3'f+t. 

s-n p >, m {a*{l3')) 
2WR 



Let 5" e X and let S > be such that S < min(e/3' 2 /2, 1/2). 
Since 

limsup —>/?', 
there exists an infinite set J C N such that for all n e J 

^>(3'-6. 

By the choice of 5, for all n e J 



i.e., 



Now, note that 



since 



< 



< 



/?' + 1 



m'B 1 - 6 = (1 + + (to - 2)B)B e 



-log m (m-2+i+^) 



_ ^l+log B m s 



B 



i+ 



= S 



i+ 



2 1og m m s -log m m s + log m (rn-2+i^-) 
2 log m B 

log m m 3 +log m ( m -2+lMl) 



2 lo gTTl B 
.!+£_ 



= B 



1+ 



s-log m (m-2+i+0-)+2 1og m (m-2+i+^-) 



= B l +£+ log B (m-2+i±^)_ 



(B.2) 
(B.3) 
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For all n G J, 



d(S[0. 



1]) ^m sn a na "{P'a) n ^ 

m s^ nB l- an -0. 



1 — a — pa x 
m — 2 



l + /3'+ (m-2)B 



l + j3' + (m- 2)B 
m s B 1 - e 



l + /3'+ (m-2)B 

IB. 31 Q tn 



Since J is an infinite set, 



limsupd(5[0..n — 1]) = oo, 



i.e., S G S 100 ^]. Since s > Tip' jTTl (a*(/3')) is arbitrary and d is finite-state s-gale, dining) < dimps(^) _ 
H >, m (a*(/3')). 

An essentially identical argument gives us dimp(X) < DiniFs(X) < W/3, m (a*(/3)). □ 

Theorem B.l. Let a > 1/ra. Let X = \ S lim ttq(S,7i) = a > and Y = < S liminf ttq(S, n) > a \. 
Then 



dimp(X) = dim H (X) = dim P (y) = dim H (T) = log,, 



1 - a 

m — 1 



Proof of Theorem IB.ll The results are clear for a — 1/m, so we assume that a > 1/ 



m. 



Let H a . m = log r . 



We first show that dimp(y) < H a m . For s > H a nl , define 



d(wb) = 



td{w) 



6 = 



It is clear that d is an s-gale. Let 



s- H n 



2 log 



(B.4) 



Note that a( T 1} > 1. Let 5 G F, i.e., liminf tt (5, n) > a. So there exists J C N such that |N\ J| < oo 
and for every n G J, 

^(S 1 , n) > a — e. 
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d(S[0..n- 1]) 



1 - a 



a(m — 1) 
1 - a 



m — 1 

2 c 



l-TI-o (S» 



1 - a 



Q-l 



a 



7r (S,n) 



1 - a 



1 - 


a 


a(m 


-1) 


1 - 


a 


a(m 


-1) 


1 - 


a 



m — 1 J \m— 1 



1— 7ro(S,n) 



m — 1 



1 - a 



7ro(S,n)— a 



Then for every n G J, 



d(5[0..n - 1]) > 



a(m — 1) 



1 - a 



Since a{ ^ ] > 1, S £ S^.[d] and dim H (r) < dim P (F) < H a>m . Note taht X C F, so dim H (X) < 
dimp(X) < # a 

Now it suffices to show that dining) > H a ^ m . 

Let 

f 1 - a 
Z={S lim 7r (5[0..n - 1]) = a and (Vi > 0) lim 7r 4 (5[0..n - 1]) = 

[ n — >oo n—*oc ffl — 1 

By Eggleston's theorem, dining) = H ajTn . Since ZCIC7, dining) > dimnPO > H ajm » □ 

Theorem B.2. (Corollary 13 in ™). Let S m 6e £/ie m-ary alphabet. Let k < m. Let ao, 0.1 
&k-i £ [0? 1] oe such that a — 2Ji=o a « — ^' 

X = ^ S lim 7T^(5, n) = ai ) 0<z<A;?. 

T/ien dimn(X) «s 



; • * * j 



K m ( QfQ? • • • j Q!jfc-1) 



1 — a 1 — a 



i — A: 



) * • * ) 



i — k 



= log„ 



a n • • ■ a 



fc-l \ m-fc 



-(1-a) 



and 



dim F sP0 = DinipsPO = dimp(X) = dim H (X). 



Proof of Theorem EOl We insist that 0° = 1 and 0/0 = 1 in the proof. 
Let 

/ 1 — a I — a 

ti = rim \ o(o,ai, . . . , at^-i, r, ■ ■ ■ , r 

\ m — k m — k 



For s > H, define 



I m s d(w)ab b < k 
a(wb) = < 

I m s d(w) ^-k otherwise. 



It is clear that d is a finite-state s-gale. Let 

S = - 



s-i? 



For 5 € X, 



-21og m (ao---a fc -i^z|)' 
lim TTi(S,n) = a;,0 <i<k. 
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So there exists no 6 N such that for all n > no \TTi(S, n) — ai\ < 5 for all i < k and that 



fe-i 



<<5 



Then for all n > 77,0, 
d(5[0..?i-l]) = 



1-a 

/77 — 



1— Sto iri(S,n) fc-1 



n 



7Ti(S,n) 



771 



- fc 



i=0 



i \ 1— E<— n T«(S,n] 

m m a„ 



n 

i=0 



s— H — a —aif—i 



> 



m a. 



s-H 



a k-l 





a \ 


-(1-a) / ! _ 




V m - 




V m — 





n 

i=0 



7Ti(S,n) 



1 — a 
m — k 



n 

2 = 



7Tj — Qfi 



m a ---a fc _i- 



1-a 
~ fc 



a 



mm 2 



= m 2 



So 5 e S£.[d\ and thus dim FS (X) < Dim FS (X) < H. 
Let 



Z= IS 



(Vi < fc) lim TTi(S,n) — oti and (Vi > k) lim iri(S,n) — 



1-a 



m — k 

By Eggleston's theorem, dining) = H. The theorem then follows from the monotonicity of dimensions. □ 

C Appendix for Section [5] 

Proof of Theorem 15.21 It is easy to see that Ttk(P) = 0. It suffices to show that 

W fc (S) > E^log fc i 



fc-i 



E ,3 lo Sfc 4 = V] ft log fc — = /3j log fe — 
a S! a, ay 

1 fc_1 1 
= log fc — < V at log fc — 

rv ■ ' * rv ■ 



i=0 



H k (a). 



Proof of Theorem 15.31 Assume a >> e [3, it suffices to show that 

H k (a) >E r5+(1 _ r)/3 -log fc |-e. 



□ 



1G 



1 fe_1 1 

E r5+(l-r)^ l0 gfc 3 ~ 6 = + t 1 - f )&) l0 Sfc — " 6 

i=0 

fc-1 ^ fe-1 ^ 

= V ra* log fc — + V(l - r)ft log fc e 

i=0 i=0 1 

- rH fe (a) + (1 - r)E-log fc - - (1 - r)e - re 
<H k (a). 

□ 

Proof of Theorem [HH Let A = {« | /i, > ft } and let B = {i \ in < ft }■ Then AnB = 0andiUB = 
[0..m - 1]. Note that for any ieAft = ^>ft and log m SM . +( }_ ;i - )/3 . > 1 and for any i G B, ft = ^ < ft 

and E ie s S (A*» - ft) lo &™ ^ + (i- s)ft < 1- Since o 1 - ft) = °i E j£j 4 - Pi) = - Eies s (m* - A)- 

Eslog m --E^log m - 
a p a 



S/Z + (1 — S)p 

-1 



S/ij + (1 - s)ft 



Therefore, 



= g ,0* - ft) i ogm SMi+( ;_ s)/3i + g - a) io gm - + ( ; _ M 

> E s(w - ft) • 1 + E *(W - ft) • 1 

> 0. 



E s log m 4 > E r 7log n 1 



i.e., a » ft □ 

Proof of Theorem 15.51 Let G = (Q, 6,0, qo, 1) be an FSG such that Q — {qo}, 6(qo, b) = qo for all b G 
and P(qo) = a. 

Let s > H-k(a) + £■ The s-gale of G is defined by the following recursion, 

A s )f m J 1 w = 6 = A 

dg (to) = < ( sl 

I k s d G (w)ab otherwise, 

for all ioeSj and 6 G S fc . Let Sel. Then 

fc-l 



4 s) (5[0..n-l]) = fc s "n^ 

^,s-E jf(s _„ ) log* 4 

Thus S G S°°[dQ ] and dimFs(S') < s, when the domination condition holds for infinitely many n. Similarly, 
S G ftf r [d[^] and Dumps (S 1 ) _• s j when the domination condition holds for all but finitely many n. The 
theorem then follows, since e can be arbitrarily small. □ 
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Proof of Theorem 15.61 We prove this by giving a counterexample with S3. This counterexample can be 
extended to larger alphabets very easily. 

L,et a - (, 300 , 300 , 300 j, p - (. 300 , 300 , 300 j. Ana we nave 

ft (a) w 0.8219015831, 

and 

ft(/3) re 0.7344147903, 

and 

ft(a) - Eg log, - ps 0.05003477990. 

a 

So a » (3. 

Note that fix a G A({0, 1, 2}), for 7 G A({0, 1, 2}), a » 7 if 

ft(a)>E 7 log 3 -, 

a 

i-e., ^ 

ft (a) > 7o log 3 l-7i log 3 1-72 log 3 — • 

ao ol\ a.2 

It is clear that a determines a hyperplane that separate the space of all probability measures. Since we only 
consider the cases where 70 + 71 + 72 = 1, the above inequality simplifies to 

ft(«) > 7o log 3 — + 71 log 3 — + (1 - 70 - 7i) log 3 ■ 

ao Oi\ 1 — ao — ai 

Let 70 = 0, we may solve the above inequality and obtain the boundary point for a at 70 = is 71 = 
Similarly, the boundary point for (3 at 70 = is approximately 71 = 0.3965181711. 
Let 7* = (0,0.37,0.63). 

ft(a) - E 7 » log 3 - PS -0.01154648767 

and 

ft(/3) - E 7 . log 3 i ps 0.02593650702. 

P 

Thus (3 dominates 7* but a does not dominate 7*. □ 
Lemma C.l. (\14V - F° r every n > m > 2 and every partition a — (ao, . . . , a m — 1) of n, there are more than 

m nW m (f)-(ra+l) log m n 

strings u of length n and #(i,u) = dj for each i G E TO . 

Theorem C.2. flBj). Letd be an s-supergale, where s G [0,oo). Then for allw G E^, I G N, andO < a G 1R, 
there are fewer than — strings u G Ej n for which d(wu) > am^ s ~ 1 ^ >l d{w). 

Proof of Theorem 15.71 First we prove dimn(X) > H . It suffices to show that for all s < H, dimn(X) > s. 

Let s < H. Let d be an arbitrary s-supergale. Let s' = (H + s)/2. Let no 6 N be such that y/rh < 
rio(H-s') and m *'"o-(m+i) iog m « > 2 «"o+i. 

Fix an 5 G X such that liminf H m (w(S, n)) > s'. 

n — >oc 

For each i > no, let {/?,,!, . . . , A,cj} A(E m ) be such that for each j G [l..Cj], ftij = — for some k < n 
and H m 0i,j) > s'; for all /3 G there exists j G [l..c»] such that |/3j,j - /3| < for all j G [l..Cj], 

there exists /? G F(S) such that — /3\ < 1/i; for all j G [l..c ?; — 1], \f3 iy j — < \; for all i > no, 

IA+1,0 — Pi,a\ < i+r- 

Now, we first construct a sequence S' G E^ 1 by building its prefixes inductively. 
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Let wq be such that \wq\ — 2 n °. Note that the choice of Wo does not affect the argument, since wo does 
not change the asymptotic behavior of the sequence. Without loss of generality, assume 7r(u>o, \ wo\) = /3n ,i- 

For all n > 0, assume w n -i is already constructed. Let w n .o = Wn-i- We construct inductively 
w n> \, . . . ,w n ^ Cn and then let w n = w n , Cn . 

For j > 0, assume is already constructed. 

Let / = uq + n — 1 . 

For each l,j, let 

Bij = {u G t?(«, = A j } . 



For each I > uq and w £ EJ„, let 



Wl w H« Si 



d(wu) < — d(w) 
m 



Since d is an s-supergale, by Theorem IC.21 for all w £ £* n , there are fewer than m sl+1 strings u £ Jj m 
for which d(wu) > -^d(w). By the choice of no, flij, and Lemma [C.li 



\B u \>m' l+1 , 

i.e., Wi iW nBi d ^ 0. 

Let ui £ W hw n For all i £ [2..2^~^], let Ui £ Wiw-m-i n B/j. 
Let w nj - = w„j-i«i . . .Uji^j.ii. 
Let 5' = lim w n . 

n — >oo 

Note that when w n is being constructed, I < \log m \w n j_i\\ . It is then easy to verify that 5' (fc S°°[d]. 
Now we verify that 11(5) = 11(5'). Then 5' £ X, since X is defined by asymptotic frequency. 
Let (3 £ 11(5) be arbitrary. For each I = n + n — 1, there exists some ji such that |/3 — 0i dl \ < y. Then 
by the construction, 

2 1 

\A w l,j, , \wi,h\) ~ Pi, ji I < Vm- 1 < -. 

\ W l,3l I « 

So it is clear that 

\A w i,ji>\ w hh\)-P\ < ~J~- 

Thus 

lim K{wi^,\wi, n \) =0. 

I — >oo 

Since wi_ n C 5' for alH = no + n — 1. So we have for all n G N, (3 £ ft n (5'), hence (3 £ 11(5'). Therefore 

n(5) c n(5'). 

Now, let /3 g n(5). Since n(5) is closed, there exists 5 > such that for all /3' G 11(5), \(3 - (3'\ > 5. 
Let ni be such that Zi = no + ni — 1 > By construction, for all I > 1%, all j G [1-.q], and all 

\wi,j-i\ < k < \wi t j\, ^ 

2y/rn 

\A w i,j,\wi,j\) -i?(m,j,k)\ < —j—- 
Also, for all I > l\ and all j £ [1..q], there exists j3' £ 11(5) such that 

\n( WlJ ,\w ld \)-P'\<^. 

Thus for all k > \wi lt i\, there exists (3' £ 11(5) such that 

— , 4-777 

\K(S,k)-p'\<—. 
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Therefore, for all k > i| 

\n(S,k)-0'\<^< 6 -. 

Thus for all sufficiently large fc, 

\7f(S,k)-0\ > S -. 

So there exists n-i E N such that for all n > n 2 , (3 n„, i.e., (3 £ n(S"). 

Now we have that S' E X. Since S' ^ S' 00 [c?], s < H is arbitrary, and d is an arbitrary s-supergale, 

dim H (X) > H. 

By a similar construction, we may prove that 

dimp(X) > P. 

In the following, we prove the finite-state dimension upper bounds. Given a E A(S m ), define B(a, r) as 
B(a,r) = A(£ m ) n {/? G M m | (V£)[$ < a im r and ft > ^m^n } . 

Let 

F(X) = {a G A(E ro ) |W(a) = tf}- 

Let e > 0. Let 

C = {B(a,f) |5gF(X)}. 

It is clear that C is an open cover of F(X). Since F(X) is compact, there exists C C A(E m ) such that 
|C| < oo and 

TOC |J B(a,f). 

Let 5 G X. Then liminf H m (T?{S, n)) < iJ. By Theorem Ol there exists a* G such that 

n — >oc 

a* >> e ir(S,n) for infinitely many n E N. Then by the construction of C, there exists a G C such that 
a* G -B(a, |). Now, we have that for infinitely many n E N, 

n m (d) = n m {d*) > E ff(s>) iog m 4r ~ | 

1 a e 

= Eff(s „) log m — + E ff(s n) log m — - ~. 
v ' a ' a* 2 

By the definition of B(a, |), 

Hm(«) > E f?(s .„ ) log m - - e, 
a 

i.e., a >> c 7r(S', n) for infinitely many neN. Since S E X is arbitrary, we may partition X as X — {J SeC Xg 
such that for every a E C, 

Xg — {S E X | a >> e 7?(5, n) for infinitely many neN}. 

Since e > is arbitrary, thus by Theorem 15.51 dimFs(^Qf) < H m (a) = H for every aeC. Since |C| < oo, 
by Theorem [33 dim F s W < H. Similarly, Dim FS (X) < P. □ 
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